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TECHNICAL  REPORT 


RESEARCH  PROGRAM  PURPOSE 

The  purpose  of  this  research  program  is  to  develop  new  concepts  and 
procedures  for  the  logical  analysis  of  decisions  involving  uncertainty, 
complexity,  and  dynamic  effects. 

SUMMARY  OF  ACCOMPLISHMENTS 

The  first  six  months  ot  the  research  program  in  decision  analysis  have 
seen  the  completion  of  one  major  project  and  significant  progress  on  three 
o'  ier  topics. 

The  research  that  is  essentially  completed  concerns  the  value  of  in¬ 
formation  in  situations  where  the  successive  pieces  of  information  may  be 
obtained  sequentially.  Results  of  this  research  have  shown  that  we  must 
be  extremely  careful  in  using  conventional  value  of  information  calculations 
in  sequential  situitions.  A  final  report  on  this  research  is  now  being  pre¬ 
pared  for  both  distribution  and  publication*;  consequently,  we  shall  not 
comment  further  on  it  at  this  time. 

The  three  main  research  projects  now  in  progress  are  concerned  with 

1)  the  economic  b.alancing  of  assessment  and  computation  in 
decision  analysis, 

2)  the  sensitivity  of  recommendations  to  choices  made  in  the 
modeling  process,  and 

3)  the  value  cf  retaining  flexibility  in  the  setting  of  deci¬ 
sion  variables  and  of  having  complete  as  opposed  to  quantized 
information. 


"The  Value  of  Sequential  Information"  by  Allen  Clinton  Miller,  III  to 
be  published  in  December  197S. 
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We  shall  now  describe  progress  on  each  of  these  projects. 

RESEARCH  PROGRESS 

THE  ECONOMICS  OF  ASSESSMENT  ANP  COMPUTATION 

The  economics  of  decision  analysis  addresses  the  challenging  area  of 
problem  formulation.  The  object  of  the  research  is  to  develop  formal  aids 
to  balance  accuracy  against  computational  simplicity.  The  ultimate  result 
is  expected  to  include  a  framework  general  enough  to  identify  most  of  the 
decision  problems  that  the  professional  analyst  faces.  The  framework  will 
structure  the  new  results,  identify  pertinent  work  in  the  literature,  and 
illuminate  areas  for  future  work. 

The  initial  state  of  information  is  summarized  b>  the  decision  maker's 
estimates  of  the  best  decision,  the  mean  and  variance  of  the  resulting 
lottery,  and  the  amount  that  these  quantities  would  change  if  they  were 
based  on  a  complete  analysis.  Each  possible  assessment  and  computational 
program  is  an  experiment  providing  more  information  about  these  quantities. 
The  experiments  are  evaluated  using  decision  theory,  with  computations 
simplified  using  Taylor  series  approximations. 

The  research  has  concentrated  on  problems  with  a  single  decision 
variable  and  many  normally-distributed  state  variables.  The  sequential 
value  of  encoding  state  variables  has  been  computed;  the  expected  gains 
from  Nk  :e  Carlo  sampling  and  from  decision  trees  have  been  evaluated.  As 
a  rccult,  the  resources  available  for  a  project  can  be  divided  between 
computation  and  assessment.  The  optimum  number  of  variables  to  be  encoded 
and  the  optimum  Monte  Carlo  sample  size  or  tree  size  can  be  computed.  The 
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techniques  have  been  applied  in  an  extensive  example,  based  on  the  actual 
decision  analysis. 

The  continuing  research  will  focus  on  broader  decision  problems. 

For  example,  discrete  state  variables  can  make  a  decision  problem  unsuit¬ 
able  for  analysis  based  on  Taylor  series.  However,  by  breaking  the  problems 
into  blocks,  the  discontinuities  can  be  removed  and  the  approximate  tech¬ 
niques  can  be  applied  to  each  portion. 

The  research  so  far  has  focused  on  the  decisions  made  between  the  de¬ 
terministic  and  probabilistic  phases  of  the  decision  analysis.  When  the 
cost  of  evaluating  the  deterministic  model  is  not  large,  this  is  the  critical 
decision  point.  However,  when  the  cost  of  evaluating  the  model  is  very  high, 
as  it  would  be,  for  example,  if  an  evaluation  of  the  model  requires  the  de¬ 
terministic  simulation  of  a  national  electrical  power  system  over  many  years, 
then  even  a  complete  deterministic  analysis  may  be  a  prohibitively  expensive 
luxury.  For  this  class  of  problems  it  may  be  best  to  do  an  immediate  Monte 
Carlo  simul  'tion  and  replace  the  sensitivity  analysis  with  least-squares 
approximations . 

THE  ADEQUACY  OF  MODELS 

The  value  of  any  decision  analysis  depends  in  part  on  the  adequacy  of 
the  mathematical  models  used  in  that  analysis.  The  object  of  the  present 
research  is  to  develop  a  methodology  with  which  the  adequacy  of  the  models 
used  in  a  decision  analysis  can  be  quickly  and  simply  determined. 
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A  typical  decision  situation  can  be  represented  as  follows: 

d 

{s|«S}  i  {yjd,<£} 

The  outcome  variable  y  is  dependent  on  a  decision  variable  d  ,  which 
is  controlled  by  the  decision  maker,  and  on  a  state  variable  s  ,  which 
is  a  random  variable  with  probability  distribution  { s  |«S }  .  The  depen¬ 

dence  of  y  on  d  and  s  is  embodied  in  the  conditional  probability  dis¬ 
tribution  { y | d , s ,-ff }  .  For  any  value  of  d  ,  the  corresponding  proba¬ 

bility  distribution  on  y  ,  called  the  profit  lottery,  can  be  found: 

* 

( y I d }  =  {y|d,s^}  •  [s\S)  ,  1) 

s 

► 

where  denotes  a  summation  over  the  variable  s  .  The  goal  of  a 

■  s 

decision  analysis  is  to  identify  the  value  of  d  that  corresponds  to  the 
most  desirable  profit  lottery. 

In  practice,  because  of  the  large  assessment  and  computational  re¬ 
quirements  implied  by  1),  the  profit  lottery  is  almost  never  calculated 
in  this  way.  Rather,  the  decision  situation  is  usually  simplified  through 
the  use  of  models : 

a)  The  dependence  of  y  on  d  and  s  is  modeled  as  a 
deterministic  function  g  :  y  =  g(d,s) 
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b)  The  probability  distribution  on  s  is  modeled  as  a 
simple  (usually  discrete)  function  p  :  =  p(s) 

Then,  with  these  models,  the  profit  lottery  is  calculated: 

=  6(y  -  g(d,s))  •  p(s)  2 

*  s 

The  models  are  adequate  for  the  purposes  of  the  analysis  if,  and  only 
if,  the  profit  lottery  in  2)  is  not  too  different  from  the  profit  lottery 
in  1).  However,  since  the  profit  lottery  in  1)  is  not  known,  the  discrep¬ 
ancy  between  tho  -wo  profit  lotteries  can  only  be  approximated. 

In  the  present  research,  methods  are  being  developed  to  characterize 
explicitly  the  error  incurred  in  the  modeling  assumptions  a)  and  b)  and 
to  approximate  the  discrepancy  between  the  profit  lotteries  caused  by  these 
modeling  errors.  The  error  in  assumption  a)  is  characterized  by  a  random 
variable  e  such  that  y  *  g(d,s)  e  .  The  error  in  b)  is  characterized 
by  the  error  in  the  mean  and  variance  of  s  caused  by  ufing  p(s)  rather 
than  {s|tf}  .  The  discrepancies  in  the  mean  and  variance  of  the  two  profit 
lotteries  are  then  shown  to  be  functions  of  these  errors,  of  moments  of  s 
and  of  derivatives  of  g 

When  this  research  is  completed,  it  should  be  possible  to  check  quickly 
the  adequacy  of  the  models  used  in  any  decision  analysis. 

FLEXIBILITY  AND  INFORMATION  QUANTIZATION 

A  particularly  useful  contribution  decision  analysis  has  made  to  the 
science  of  decision-making  is  a  logical  technique  for  placing  a  dollar 
value  on  information.  We  are  currently  extending  these  techniques  so  as  to 
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find  the  economic  value  of  information  systems;  that  is,  we  are  searching 
for  techniques  for  determining  in  the  context  of  a  particular  problem  when 
information  should  be  collected,  how  it  should  be  transmitted,  and  where  it 
should  be  used.  By  weighing  the  economic  value  versus  the  cost  of  various 
informational  systems,  the  decision  maker  will  have  a  valuable  tool  for  the 
design  and  analysis  of  systems  for  th»*  accumulation,  transmission,  and  in¬ 
corporation  of  data. 

How  many  times  have  we  heard  the  phrase,  "If  I  only  knew  then  what  I 
know  now."  Such  a  phrase  points  out  the  simple  fact  that  the  value  one 
places  on  information  is  strongly  influenced  by  one's  "flexibility";  that 
is,  his  ability  to  adjust  his  decision  strategy  in  response  to  reported 
knowledge.  Therefore  to  be  precise,  a  statement  about  the  value  of  infor¬ 
mation  on  some  uncertain  variable  must  be  accompanied  by  a  statement  about 
which  decision  variables  (those  variables  under  the  control  of  the  decision 
maker)  may  be  adjusted  in  response  to  the  impending  information. 

Specifically,  suppose  that  important  variables  associated  with  a 
particular  decision  problem  have  been  divided  into  uncertain  state  variables 

(s  , _ ,s„)  and  decision  variables  (d  ,...,d,f)  .  We  can,  for  example, 

calculate  the  value  of  information  on  state  variable  s^  given  flexibility 
on  decision  variable  d^  .  This  value  is  interpreted  as  the  economic  bene¬ 
fit  gained  by  utilizing  the  information  about  the  state  variable  i  when 
setting  the  decision  variable  j  .  Since  the  combined  cost  of  supplying 
the  information  and  adjusting  the  decision  variable  may  or  may  not  outweigh 
this  benefit,  it  may  or  may  not  be  profitable  to  incorporate  some  piece  of 
information  into  some  aspect  of  the  decision-making  process.  Being  able  to 
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calculate  the  value  of  supplying  knowledge  of  various  state  variables 
while  retaining  flexibility  of  various  decision  variables  should  aid  a 
manager  in  designing  and  timing  information  transmission  for  the  purpose 
of  decision-making. 

A  consideration  almost  as  fundamental  as  the  distribution  of  infor¬ 
mation  is  the  accuracy  with  which  it  will  be  reported.  A  basic  source 
of  distortion  in  information  transmission  is  quantization.  Quantization 
takes  place  whenever  physical  quantities  are  represented  numerically; 
further  "rounding  off"  is  likely  to  take  place  in  the  reduction  and  pro¬ 
cessing  of  data.  Finally,  because  of  the  large  number  of  variables  in 
many  decision  problems,  rough  quantization  of  variables  to  as  few  as 
three  levels  is  frequently  necessary  to  reduce  to  a  computation  of 
manageable  size. 

We  have  found  that  we  can  make  a  calculation  very  similar  to  the  value 
of  information  calculation  that  will  allow  us  to  place  a  dollar  value  on 
the  distortion  caused  by  a  particular  quantization  scheme.  Quantization 
in  the  information  system  can  be  thought  of  as  a  state  space  partitioning 
as  follows.  Rather  than  learning  the  exact  value  of  a  state  variable  prior 
to  setting  a  decision  variable,  a  quantized  report  tells  us  only  that  its 
exact  value  lies  in  one  of  a  mutually  exclusive,  collectively  exhaustive 
collection  of  subsets  Sj,...,S^  .  Specification  of  these  subsets  is 

equivalent  to  specifying  the  quantizing  scheme.  Two  important  questions 
emerge:  First,  what  is  the  value  of  a  particular  level  of  discretization? 
Second,  how  should  the  partition  Sj,...,S^  be  determined? 
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A  thorough  answer  to  these  questions  would  lead  to  a  means  for 
determining  and  evaluating  optimal  quantized  information  systems  for 
decision  problems.  So  far  our  analysis  has  lead  to  several  interesting 
results.  The  economic  loss  associated  with  the  use  of  a  particular 
number  N  of  quantization  levels  tends  to  decrease  rapidly  with  .  r  in¬ 
crease  in  N  .  For  example,  if  we  have  a  uniformly  distributed  state 
variable  and  a  quadratic  value  function,  this  cost  decreases  as  1/N2 
Our  preliminary  results  indicate  that  very  rough  quantization  to  as  few 
as  three  levels  gives  relatively  small  distortion  losses.  We  have  also 
found  that  optimal  quantizing  schemes  exist  that  give  significantly  better 
performance,  and,  in  some  cases  at  least,  the  optimal  and  quantizing 
partitions  can  be  very  easily  constructed. 

We  are  optimistic  that  continued  research  into  the  areas  of  flexi¬ 
bility  and  quantization  in  informational  systems  will  continue  to  yield 
results  of  practical  as  well  as  theoretical  importance  to  the  decision 
maker.  Just  at  a  time  when  we  are  becoming  more  and  more  aware  of  the 
necessity  for  utilizing  available  information,  the  compilation  and  trans¬ 
mission  costs  of  data  are  declining.  Surely  a  framework  is  needed  for 
balancing  the  economic  benefits  and  costs  associated  with  information 
usage. 
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